Examining the validity of the Mini-Mental State Examination (MMSE) and its domains using network analysis.

BACKGROUND: The Mini-Mental State Examination (MMSE) is the most widely used standardised screener for impairments across a range of cognitive domains. However, the degree to which its domains (orientation, registration, attention, recall, language, and visuospatial) capture cognitive functioning measured using standardised neuropsychological tests is unclear. METHOD: A longitudinal research design with four biannual assessments over a 6-year period was used with an initial sample of 1037 older adults (aged above 70 years). Participants completed MMSE and neuropsychological tests at each assessment. Network analysis was utilised to investigate unique associations among the MMSE and its domains and neuropsychological test performance at each time point. RESULTS: The total MMSE and two of its domains, language and recall, were associated with neuropsychological memory performance. The MMSE orientation, registration and visuospatial domains did not have any unique associations with neuropsychological performance. No stable internal interconnections between MMSE domains were found over time. The association of total MMSE as well as its recall domain with neuropsychological memory performance remained very similar over the 6-year period. CONCLUSIONS: The present study adds evidence to the validity of the MMSE and supports the clinical usage of the MMSE, whereby the total score is used for screening patients with or without cognitive impairments, with repeated administration to monitor cognitive changes over time, to inform intervention. However, the tool is not able to diagnose the cases for changes in specific cognitive domains and as such, should not replace a complete neuropsychological assessment.

Using network analysis to validate domains of the modified telephone interview for cognitive status.

BACKGROUND: The modified Telephone Interview for Cognitive Status (TICS-M) is a widely used tool for assessing global cognitive functions and screening for cognitive impairments. The tool was conceptualised to capture various cognitive domains, but the validity of such domains has not been investigated against comprehensive neuropsychological assessments tools. Therefore, this study aimed to explore the associations between the TICS-M domains and neuropsychological domains to evaluate the validity of the TICS-M domains using network analysis. MATERIALS AND METHODS: A longitudinal research design was used with a large sample of older adults (aged above 70 years; n = 1037 at the baseline assessment) who completed the TICS-M and comprehensive neuropsychological assessments biennially. We applied network analysis to identify unique links between the TICS-M domains and neuropsychological test scores. RESULTS: At baseline, there were weak internal links between the TICS-M domains. The TICS-M memory and language domains were significantly related to their corresponding neuropsychological domains. The TICS-M attention domain had significant associations with executive function and visuospatial abilities. The TICS-M orientation domain was not significantly associated with any of the five neuropsychological domains. Despite an attrition of almost 50% at wave four, weak internal links between the TICS-M domains and most associations between TICS-M and neuropsychological domains that were found initially, remained stable at least over two waves within the 6-year period. CONCLUSIONS: This study supports the overall structural validity of the TICS-M screener in assessing enduring global cognitive function. However, separate TICS-M cognitive domains should not be considered equivalent to the analogous neuropsychological domains.

Establishing conversion of the 16-item Informant Questionnaire on Cognitive Decline in the Elderly scores into interval-level data across multiple samples using Rasch methodology.

BACKGROUND: The 16-item Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE-16) is a well-validated and widely-used measure of cognitive changes (CCs) among older adults. This study aimed to use Rasch methodology to establish psychometric properties of the IQCODE-16 and validate the existing ordinal-to-interval transformation algorithms across multiple large samples. METHODS: A Partial Credit Rasch model was employed to examine psychometric properties of the IQCODE-16 using data (n = 918) from two longitudinal studies of participants aged 57-99 years: the Older Australian Twins Study (n = 450) and the Canberra Longitudinal Study (n = 468), and reusing the Sydney Memory and Ageing Study (MAS) sample (n = 400). RESULTS: Initial analyses indicated good reliability for the IQCODE-16 (Person Separation Index range: 0.82-0.90). However, local dependency was identified between items, with several items showing misfit to the model. Replicating the existing Rasch solution could not reproduce the best Rasch model fit for all samples. Combining locally dependent items into three testlets resolved all misfit and local dependency issues and resulted in the best Rasch model fit for all samples with evidence of unidimensionality, strong reliability, and invariance across person factors. Accordingly, new ordinal-to-interval transformation algorithms were produced to convert the IQCODE-16 ordinal scores into interval data to improve the accuracy of its scores. CONCLUSIONS: The findings of this study support the reliability and validity of the IQCODE-16 in measuring CCs among older adults. New ordinal-to-interval conversion tables generated using samples from multiple independent datasets are more generalizable and can be used to enhance the precision of the IQCODE-16 without changing its original format. An easy-to-use converter has been made available for clinical and research use.

Investigating Stable and Dynamic Aspects of the Vietnamese Self-Compassion Scale using Generalisability Theory.

Objectives: Evaluating comprehensive reliability of the Vietnamese Self-Compassion Scale (VSCS) and its ability to distinguish between trait (stable) vs state (dynamic) aspects of self-compassion using Generalisability Theory (G-Theory) is necessary. This investigation contributes to both reliability and validity of research that uses the VSCS to measure self-compassion in Vietnamese adults. Methods: In a sample of 155 Vietnamese adults who completed the VSCS at three occasions that were each 2 weeks apart, a G-study was conducted to measure reliability and trait vs state aspects of each VSCS subscale and the short-form VSCS, and a D-study was conducted to examine the effects of removing subscales on overall scale reliability as well as evaluate trait vs state aspects of each item. Results: With G-coefficients of 0.93-0.98, both the complete and short-form VSCS (VSCS-SF) demonstrated excellent reliability in measuring trait self-compassion. Three of the six subscales-self-judgement, mindfulness, and kindness-also demonstrated excellent reliability, with G-coefficients of 0.82-0.85. Eighteen of the 26 items measured trait more than state. The remaining eight items reflected a mixture of trait and state, but this did not affect overall reliability. Conclusions: This study indicated that the VSCS, VSCS-SF, and three VSCS subscales reliably measured trait self-compassion, with scores generalisable across the Vietnamese population and occasions. Thus, overall self-compassion levels remained stable over time, which is useful for evaluating the effectiveness of an intervention because significant changes of self-compassion are likely to be long-lasting. Supplementary Information: The online version contains supplementary material available at 10.1007/s12671-022-01950-3.

Enhancing precision of the 16-item Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE-16) using Rasch methodology.

OBJECTIVE: This study aimed to investigate psychometric properties and enhance precision of the 16-item Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE-16) up to interval-level scale using Rasch methodology. DESIGN: Partial Credit Rasch model was applied to the IQCODE-16 scores using longitudinal data spanning 10 years of biennial follow-up. SETTING: Community-dwelling older adults aged 70-90 years and their informants, living in Sydney, Australia, participated in the longitudinal Sydney Memory and Ageing Study (MAS). PARTICIPANTS: The sample included 400 participants of the MAS aged 70 years and older, 109 out of those were diagnosed with dementia 10 years after the baseline assessment. MEASUREMENTS: The IQCODE-16. RESULTS: Initial analysis indicated excellent reliability of the IQCODE-16, Person Separation Index (PSI) = 0.92, but there were four misfitting items and local dependency issues. Combining locally dependent items into four super-items resulted in the best Rasch model fit with no misfitting or locally dependent items, strict unidimensionality, strong reliability, and invariance across person factors such as participants' diagnosis and relationship to their informants, as well as informants' age and sex. This permitted the generation of conversion algorithms to transform ordinal scores into interval data to enhance precision of measurement. CONCLUSIONS: The IQCODE-16 demonstrated strong reliability and satisfied expectations of the unidimensional Rasch model after minor modifications. Ordinal-to-interval transformation tables published here can be used to increase accuracy of the IQCODE-16 without altering its current format. These findings could contribute to enhancement of precision in assessing clinical conditions such as cognitive decline in older people.

Cross-cultural validation of the stroke riskometer using generalizability theory.

The Stroke Riskometer mobile application is a novel, validated way to provide personalized stroke risk assessment for individuals and motivate them to reduce their risks. Although this app is being used worldwide, its reliability across different countries has not yet been rigorously investigated using appropriate methodology. The Generalizability Theory (G-Theory) is an advanced statistical method suitable for examining reliability and generalizability of assessment scores across different samples, cultural and other contexts and for evaluating sources of measurement errors. G-Theory was applied to the Stroke Riskometer data sampled from 1300 participants in 13 countries using two-facet nested observational design (person by item nested in the country). The Stroke Riskometer demonstrated strong reliability in measuring stroke risks across the countries with coefficients G relative and absolute of 0.84, 95%CI [0.79; 0.89] and 0.82, 95%CI [0.76; 0.88] respectively. D-study analyses revealed that the Stroke Riskometer has optimal reliability in its current form in measuring stroke risk for each country and no modifications are required. These results suggest that the Stroke Riskometer's scores are generalizable across sample population and countries permitting cross-cultural comparisons. Further studies investigating reliability of the Stroke Riskometer over time in longitudinal study design are warranted.